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Andreev Edge State on Semi-Infinite Triangular Lattice: Detecting the Pairing 

Symmetry in Na .35CoO2 ■ yH 2 
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We study the Andreev edge state on the semi-infinite triangular lattice with different pairing 
symmetries and boundary topologies. We find a rich phase diagram of zero energy Andreev edge 
states that is a unique fingerprint of each of the possible pairing symmetries. We propose to pin 
down the pairing symmetry in recently discovered Na a; Co02 material by the Fourier-transformed 
scanning tunneling spectroscopy for the edge state. A surprisingly rich phase diagram is found and 
explained by a general gauge argument and mapping to ID tight-binding model. Extensions of this 
work arc discussed at the end. 



Recently, Takada et al. discovered that Nao.3sCo02 • 
J/H2O undergoes a superconducting phase transition 
around 5 K|lJ. Despite the low critical tempera- 
ture, it triggered intense attentions from both the 
emerimentalji S 0, H H and theoretical H 
111! [T3 . fl3| sides of the scientific community due to its 
similar planar structure to the high T c materials. In con- 
trast to the square lattice in cuprates, the Co atoms form 
a two-dimensional triangular lattice without orbital de- 
generacy. 

Since the antiferromagnetic correlations are frustrated 
in the triangular lattice, Baskaran 8J explored the impli- 
cations of resonant valence bond (RVB) physics in this 
material. Based on the RVB picture, theoretical inves- 
tigations on the t-J model|ll| favor d x 2_ y 2+id xy sym- 
metry. Taking a different perspective, Tanaka and Hu@ 
proposed that the peculiar shape of Fermi surface sta- 
bilizes Px+iPy spin-triplet pairing. On the other hand, 
starting from fluctuation-exchange approximation, the 
simple /-wave pairing is predicted [12|, which is also sug- 
gested by RPA calculations^ and is strongly tied to 
the charge fluctuations in the system. Since various ap- 
proximations are assumed in the above approaches, the 
pairing symmetry in Na^CoC^ remains controversial at 
the point of writing. 

While it is important to determine the pairing sym- 
metry from a microscopic approach, it is as important 
to understand the phenomenology associated with dif- 
ferent pairing symmetries. In this Letter, we study 
the Andreev edge state (AES) localized at the bound- 
ary and propose to pin down the pairing symmetry 
by Fourier-transformed scanning tunneling spectroscopy 
(FT-STS)HlEi- Due to growing evidence for the exis- 
tence of nodes in the gappj|El, we would concentrate 
on the p, d and / pairing symmetries here. Furthermore, 
since detailed calculations for different symmetries are 
rather similar, we only elaborate on the simplest /-wave 
pairing, which fits well with the hexagonal symmetry in 
the triangular lattice and does not break time reversal 
symmetry. 



zigzag edge 


flat edge 


pairing symmetry 


Yes 


No 


/ or p x 


No 


Yes 


Py 


Yes 


Yes 


dxy 


No 


No 


d x 2. y 2 or s 



TABLE I: Existence of Andreev bound state at zigzag and 
flat edges and its implication for pairing symmetry. 



Note that there are two natural boundary topologies 
on the triangular lattice - zigzag and flat edges, as shown 
in Fig. ^ For /-wave symmetry, the Andreev edge state 
exists at zigzag edge for some momenta k y along the 
boundary while it is absent at the flat edge. The results 
for other pairing symmetries are summarized in Tabled 

Recent breakthrough in FT-STS experiments allow 
further insight into the edge state, beyond its detection 
only. In these experiments one probes the local density 
of states (LDOS) of a two dimensional sample surface on 
a large field of view that allows good resolution of the 
Fourier transformed data. In the case of AES, their ex- 
ponential decay away from the boundary can be detected 
directly while their dependence upon the transverse mo- 
mentum (along the edge where the system is translation- 
ally invariant) can be seen in Fourier space through scat- 
tering processes. In this Letter we show that different 
pairing symmetries give rise to edge states with different 
transverse momentum profiles. For instance, the struc- 
ture of the LDOS for the /-wave pairing at zigzag edge 
gives rise to interference pattern of quasi-particle scat- 
tering which peaks at Q = ±7r/\/3a after the STS data 
is Fourier analyzed. 

Another interesting aspect is the richness of the phase 
diagram at different momentum k y , arising from the tri- 
partite property of the triangular lattice. We develop a 
general mapping to ID tight-binding model which com- 
bines the subtle interplay between the symmetry of the 
order parameter and the topology of the boundary to- 
gether. The complicated phase diagram of AES can be 
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FIG. 1: Gap function of p x , p y , d xy and d x i- y i symmetries at 
two different zigzag and flat edges for the triangular lattice. 
The /-wave pairing potential is shown in the middle shaded 
hexagon, with signs determined by either parallel (A > 0) or 
anti-parallel (A < 0) to the arrows. In the lower panel, the 
Fermi surface in the reconstructed Brillouin zone is shown. 
The thick contours are at different chemical potentials, fi/t = 
2 (middle circle), fi/t — (fragmented circle) and fi/t = —2 
(two triangles). The nodes are located at the intersections of 
the Fermi surface contours and the nodal lines. 



understood as some intrinsic property of the hopping ma- 
trix in the effective ID lattice. In addition, it is evident 
in the phase diagram that the different phases (whose 
nature will become clear shortly) are separated by the 
nodal extended states. This can be shown by Oshikawa's 
gauge argument [l^ l20| . 

To obtain the phase diagram of AES, let us start with 
the Bogoliubov-de Gennes Hamiltonian for /-wave pair- 
ing with zigzag edge, 

H B dG = t ^2 c «( r ) c «( r ') ~ ^ cj e (r)c ct (r) 

(r,r'),a r,a 

+ ^[A*(r,r0c T (r) Cl (r') + A(r,r')4(r) c ;(r0]. (1) 

(r,r') 

Here only nearest-neighbor hopping and pairing are in- 
cluded. Since the triangular lattice is not particle-hole 
symmetric, the sign of the hopping amplitude is impor- 
tant. Recent experiments^! |22| suggest that the max- 
imum of the band occurs at the T point, which im- 
plies t > 0. The /-wave paring potential A(r, r') = 
— A(r',r) = ±A, with signs depending on the bond ori- 
entation as shown in Fig. ^ The anti-symmetric spatial 
dependence arises from spin triplet pairing. 

The above Hamiltonian can be decomposed into a sum 



of ID Hamiltonians by partially Fourier transforming 
in the edge direction (y). Note that the conventional 
hexagonal Brillouin zone must be folded into the par- 
ticular rectangle (shown in Fig. to keep the Fermi 
statistics |l8(. Each ID Hamiltonian can be conveniently 
written in the basis of bonding and antibonding of par- 
ticle and hole creation operators, 



HF(ky) 



V2 



C]{x,k,y) + c| (x, — ky) 
-c T (x, k v ) + c^(x, ~k v ) 



(2) 



The Hamiltonian takes the simple (supersymmetric) 
Dirac form, 




ky \ 



where the semi- infinite matrix A is 

/-M T x T 2 

Ti -ii T x T 2 

T 2 Tx -n Tx T 2 

T- 2 Tx -n Tx 



a)- 



(3) 



A = 



\ 



(4) 



The matrix elements carry momentum dependence be- 
cause of the partial Fourier transformation, Ti j = 2(t =F 
A) cos(-s/3/c y /2) and T 22 — t ± A. The appearance of 
non-zero T 2 and T 2 is the signature of the underlying 
tripartite lattice. 

It is straightforward to show that zero-energy states 
exhibit a "nodal structure" , 



I*- 





(5) 



Here (f>-(x) and <fi+(x) belong to the kernel space of 
the semi-infinite matrix A and A^ respectively. The 
edge state can be constructed from the generalized Bloch 
states, 4>~{x) — J2i a i( z i) x > where z satisfies 



T 2 z 2 



T lZ 



z A 



ft. 



(6) 



In general, the above equation has four solutions Zi . How- 
ever, the open boundary requires 



!>-(-!) =0, </>_(0)=0, |0_(oo)|<oo. 



(7) 



To satisfy the boundary conditions, we need at least three 
\zi\ < 1 solutions to construct one edge state 4>-(x). Oth- 
erwise, the edge state would be absent. If all of the four 
solutions satisfy \zi\ < 1, we end up with two edge states. 
It is clear that we can find <p+ (x) in the similar way. The 
resultant phase diagram of the AES is shown in Fig. [21 



3 



k y =-n/j3 k y =0 k y = %/j3 
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FIG. 2: Phase diagram for Andreev edge states. The single 
circles mark the nodal points without degeneracy while the 
double circles denote those with two-fold degeneracy. The 
thick single dashed (yellow) and solid (green) lines indicate 
the edge state of different particle-hole parities, while the dou- 
ble line denote two independent edge states. 



The detailed derivation of these solutions will be pre- 
sented elsewhere |2^| . 

Before diving into the details of the phase diagram, one 
notices that an edge state of a certain kind (i.e., | V E'+) or 
1^-)) always starts/ends at nodal points. This feature 
is inaccessible by the conventional Andreev equations in 
the continuous limit which breaks down near the nodal 
points. Interestingly, this global structure of the phase 
diagram is rather general for zero-energy states and can 
be explained eleg antly by the modified Oshikawa's gauge 
argument 0, l20l| 

Suppose we wrap up the semi-infinite lattice into tubu- 
ral conformation and thread a unit flux $0 = 27r through 
it. After a large gauge transformation to eliminate the 
flux, the original edge state is mapped into another one 
with momentum shift Ak y = 2tt/L, where L is the cir- 
cumference of the tube. All edge states between nodal 
points can be mapped into each other by the flux-gauge 
transformation because the energy spectrum is gapped. 
This simple but elegant argument explains the interesting 
structure in Fig. |2| 

The richness of the phase diagram brings up another 
puzzle. The existence of the edge state is often under- 
stood as the sign change of order parameter at the open 
boundary, which is robust without detailed dependence 
on k y . Thus, we expect that the phase diagram would 
be rather simple in the whole Brillouin zone. For simpler 
systems like the d-wave superconductor on the square 
lattice, this sort of understanding seems to hold rather 
well. So, what causes the complications on the trian- 
gular lattice? The puzzle can be answered by mapping 
the problem into the effective ID nearest neighbor tight- 
binding model. 

Any lattice system in arbitrary dimension with open 
boundary at x = 0, which is described by a quadratic 



«t = 4 
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FIG. 3: Local density of states D(x,k v ) at different chemical 
potentials. The parameters are chosen to be, t = 1 and A = 
0.4, in order to visualize the momentum profile. The features 
are robust against small changes in A/t. 
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Hamiltonian can be mapped into a sum of (fc y -dependent) 
one-dimensional models. By choosing an appropriate 
unit cell the one dimensional chain will contain only near- 
est neighbor hopping and in general their Hamiltonian is 
then given by 



H 



R 



d <g> R f + C <g> 1, 



(8) 



where Ci is the hopping matrix connecting nearest- 
neighbor cells and Co = Cj for hopping within the cell. 
The matrices Co and Ci are square matrices with s rows, 
where s is the number of effective lattice sites in the unit 
cell. The semi-infinite matrix (R) x ,x' = $x+i,x' is the 
displacement operator on the lattice. 

Again, the edge state can be constructed from 
Bloch states, <b(x) — J2i a i ( t ) i( z i) x ■> wner e z satisfies 



zC\ + id + Co 



det 



extremely simple in this representation, 



0. The boundary condition is 



C 1 *(O)=^C 1 (a i i )=O. 



(9) 



Therefore, the number of edge states is exactly the di- 
mension of subspace of the kernel space of Ci, which is 
spanned by the vectors Consequently, the maxi- 

mum number of edge states is just the dimension of the 
kernel space of Ci. On the other hand, if the rank of 
matrix Ci is full, it implies no edge. In fact, the reflec- 
tion symmetry with respect to the open boundary often 
implies that the rank of Ci is full|2^]. For this reason, in 
some edge topologies, there is never an edge state. 

We are now ready to zoom into the details of the 
phase diagram. To visualize these edge states better, 
we calculated the local density of states at zero energy, 
D{x,k y ) = Eil^iO)! 2 ^), as shown in Fig. ES For 
2 <///<< 6, there are three maxima in the LDOS aris- 
ing from edge states with opposite parities. Note that the 
edge state merges into the bulk at the nodal points and 
the weight of the LDOS is suppressed to zero. The (elec- 
tron) filling factor x = 1.35 in Na^Co02 compound cor- 
responds to the regime < fi/t < 2 where the phase dia- 
gram is quite complicated. However, the locations of the 
LDOS maxima are rather simple, k y — ±7r/\/3, 0. There- 
fore, we expect to see a sharp peak at Q y — ±7r/voa in 
the STM data after Fourier analysis. For —2 < fi/t < 0, 
the structure of LDOS is pretty much the same except for 
an additional regime where the LDOS vanishes. Again, 
it would predict the same sharp peak at Q y = ±n/y/3a 
in the STM data. Finally, for -3 < fi/t < -2, there is 
no edge state. 

The approach developed here can be directly applied 
to other pairing symmetries such as p- or rf-wave. Since 
these pairing symmetries do not match the hexagonal 
symmetry, the result sensitively depends on the orienta- 
tions of the gap functions relative to the underlying lat- 
tice. As in the high TL materials, the correlation length 
in Na.j;Co02 is small 71. It is then reasonable to assume 



that the orientation of the gap function is pinned to the 
lattice, i.e. either the maximal gap line or the nodal line 
would lay on a lattice bond. This gives rise to eight pos- 
sibilities (shown in Fig.^) of p x , p y , d xy and d x 2„ y 2 sym- 
metries at zigzag and flat edges. Since the calculations 
are rather straightforward, the results are summarized in 
Table [I] with detailed phase diagrams deferred for future 
publication. 

Our approach presented in this Letter ignores the dis- 
order and correlation effects. While it was demonstrated 
in the literature that the weak impurities and disloca- 
tions do not destroy the AES, correlation effects can be 
more dramatic. In fact, it is rather interesting to explore 
some exotic phenomena such as spin-charge separation 
in these effective one-dimensional system, which may be 
rather different from the true ladder- like materials. An- 
other extension of our work would be to include the phase 
fluctuations of the order parameter and formulate the ef- 
fective theory in terms of gauge fields. In summary, we 
found that the AES reveals rich and interesting struc- 
tures which can serve as a good indicator for the pair- 
ing symmetry. The phase diagram can be understood 
by the more general mapping/ argument, suggesting that 
the phenomena presented here are robust with respect to 
minor details. Further studies to include the correlation 
effects would shed light on interesting bulk physics by 
probing the edge. 

We acknowledge Leon Balents, Matthew Fisher, Mar- 
cel Franz, Chung- Yu Mou, Gil Rafael and Sungkit Yip 
for useful discussions. HHL appreciates financial sup- 
ports from National Science Council in Taiwan through 
Ta-You Wu Fellow and grants NSC-91-2120-M-007-001 
and NSC-92-2112-M-007-039. TPB wishes to acknowl- 
edge NSERC for financial support. The hospitality of 
KITP, where most of the work was done, is greatly ap- 
preciated. 



[1] 

[2] 
[3] 

[4] 

[5] 
[6] 

[7] 
[8] 
[9] 

[10] 



On leave from Department of Physics, National Tsing- 

Hua University, Hsinchu 300, Taiwan 

K. Takada et ai, Nature 422, 53 (2003). 

H. Sakurai et ai, Phys. Rev. B 68, 132507 (2003). 

B. Lorentz, J. Cmaidalka, R.L. Meng and C.W. Chu, 

Phys. Rev. B 68, 132504 (2003). 

R.E. Schaak, T. Klimczuk, M.L. Foo and R.J. Cava, Na- 
ture 424, 527 (2003). 

Cao et al, J. Phys. Condesed Matter 15, L519 (2003). 
R. Jin, B.C. Sales, P. Khalifah and D. Mandrus, Phys. 
Rev. Lett. 91, 217001 (2003). 

F. C. Chou et ai, Phys. Rev. Lett. 92, 157004 (2004). 

G. Baskaran, Phys. Rev. Lett. 91, 097003 (2003). 

A. Tanaka and X. Hu, Phys. Rev. Lett. 91, 257006 
(2003). 

W. Koshibae and S. Maekawa, Phys. Rev. Lett 91, 
257003 (2003); B. Kumar and B.S. Shastry, Phys. Rev. 
B 68, 104508 (2003). 



■5 



[11] Q.-H. Wang, D.-H. Lee and P. A. Lee, Phys. Rev. B 69, 
092504 (2004). 

[12] H. Ikeda, Y. Nisikawa and K. Yamada, J. Phys. Soc. Jpn. 
73, 17 (2004). 

[13] Y. Tanaka, Y. Yanase and M. Ogata, J. Phys. Soc. Jpn. 

73, 319 (2004). 
[14] J.E. Hoffman et al, Science 297, 1148 (2002). 
[15] K. McElroy et al, Nature 422, 592 (2003). 
[16] K. Ishida et al, J. Phys. Soc. Jpn. 72, 3041 (2003). 



[17] T. Fujumoto et al, Phys. Rev. Lett. 92, 047004 (2004). 

[18] H.-H. Lin, Phys. Rev. B 58, 4963 (1998). 

[19] M. Oshikawa, Phys. Rev. Lett. 84, 1535 (2000). 

[20] H.-H. Lin and G. Refael, preprint (unpublished). 

[21] D.J. Singh, Phys. Rev. B 61, 13397 (2000). 

[22] T. Valla et al, Nature 417, 627 (2002). 

[23] T. Pereg-Barnea and H.-H. Lin, work in progress. 



